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SYSTEM AND METHQD^OR IMAGE COMPRESSION AND DECOMPRESSION 



This application claims the benefit of U.S. 
Provisional Application No. 60/040,241, filed* March 11, 
1997, System and Method for Still Image Compression, 
which is incorporated herein by reference. 



Field of the Invention 



The present invention relates generally to 
digital image compression/decompression, and 
particularly, to a wavelet-based system and method of 
10 image compression and decompression. 

Background of the Invention 

Nearly every computer user needs to store, 
transfer, and view images; These images include still 
images, or pictures, as well as video images, which are 

15 sequences of still images displayed in a manner that 

depicts motion. The enormous size of image files leads 
to serious file management limitations. For example, a 
single still image (equivalent to a video frame) 
displayed by a rectangular array of picture elements 

20 (pixels) arranged in 640 rows and 800 columns, with the 
color of each pixel represented by twenty-four bits, 
would require over 1.5 megabytes of digital memory to 
store. One solution to this problem is high-quality data 
compression technology. Essentially, image compression 

25 mathematically transforms a grid of image pixels into a 
new, much smaller set of digital values holding the 
information needed to regenerate the original image or 
data file. 

n additi&Rv^imaging systems, compression 
30 technology can be incorporated into "video on demand" 

systems, such as video servers. Compression technology 
can also be applied to streaming video, which is the 
real-time capture and display\of video images over a 
communications link. Applications for streaming video 
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include video telephones, remote security systems, and 
other types of monitoVing systems. 

Several standards for compressing real-time 
video currently exist. The H.263 standard for real-time 
5 video is an industry standard based upon the discrete co- 
sign transform (DCT) . DCT is also the basis for both of 
the public domain image compression standards, MPEG 
(Motion Picture Experts Group) and JPEG (Joint 
Photographic Experts Group) . Although the DCT approach 

10 performs interframe coding adequately, its compression 
ratio and speed can be improved upon. 

Various other types- of data compression have 
been developed in recent years. Conventional data 
compression techniques are generally referred to as being 

15 either "lossless" or "lossy", depending upon whether data 
is discarded in the compression process. Examples of 
conventional lossless compression techniques include 
Huffman encoding, arithmetic encoding, and Fano-Shannon 
encoding. With a lossless compression, the decompression 

20 process will reproduce all bits of the original image. 
Lossless compression is important for images found in 
such applications as medical and space science. In such 
situations, the designer of the compression algorithm 
must be very careful to avoid discarding any information 

25 that may be required or even useful at some later point. 

Lossy compression, in contrast, provides greater 
efficiency over lossless compression in terms of speed 
and storage, as some data is discarded. As a result, " 
lossy techniques are employed where some degree of 

30 inaccuracy- relative to the input data is tolerable. 
Accordingly, lossy compression is frequently used in 
video or commercial image processing. Two popular lossy 
image compression standards are the MPEG and JPEG 
compression methods. 

35 The wavelet transform has proven to be one of 

the most powerful tools in the. .field of data compression. 
Theoretically, the wavelet transformation is 1 lossless, 
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logic components, or any combination of the 
aforementioned. 

According to another aspect of the present 
invention, a corresponding image decompression system is 
5 provided. 

Brief Description of the Drawings 

The invention is pointed out with particularity 
in the appended claims. However, other features of the 
invention will become more apparent, and the invention 
10 will be best understood by- referring to the following 

. detailed description in conjunction with the accompanying 
drawings, in which: 

FIG. 1 illustrates a flow diagram for a method 
of compressing an image that is in accordance with an 
15 embodiment of the present invention; 

FIGS. 2-4 depict wavelet coefficients for 
various levels of decomposition; 

FIG. 5 illustrates a flow diagram of a method of 
decompressing an image that has been compressed using the 
20 method of FIG. 1; 

FIG. 6 is a block diagram of a system that can 
incorporate a software program implementing any of the 
methods shown in FIGS. 1, 5, and 8-13 in accordance with 
a second embodiment of the present invention; 
25 FIG. 7 is a block diagram of a system for 

compressing and decompressing an image in accordance with 
another embodiment of the present invention; 

FIG. 8 illustrates a flow diagram of a method 
compressing an image that is in accordance with a further 
30 embodiment of the present invention; 

FIG. 9 illustrates a flow diagram of a method 
for decompressing an image that has been compressed 
according to the method of FIG. 8; 

FIG. 10 illustrates a flow diagram of a method 
35 of compressing an image in accordance- with a further . ■ 
embodiment of the present invention;- — . 




-6- 

FIG. 11 illustrates a flow diagram of a method 
of decompressing an image that has been compressed 
according to the method of FIG, 10; 

FIG. 12 illustrates a flow diagram of a method 
5 of compressing an image that is in accordance with a 
further embodiment of the present invention; and 

FIG. 13 illustrates a flow diagram of a method 
for decompressing an image that has been compressed 
according to the method of FIG. 12. 

10 Detailed Description of the Preferred Embodiments 

Referring now to the drawings, and in particular 
to FIG. 1, there is shown a flow diagram of a method for 
compressing an image that conforms to a first embodiment 
of the invention. In step 20, a digital image is 

15 received from an image source. The digital image 

consists of a matrix of values representing an array of 
pixels. Specifically, the array of pixels represents a 
still image or a frame from a video image. In step 22, 
the image is optionally displayed on an appropriate 

20 viewing device, such as a computer or video display unit 
having a flat panel or cathode ray tube (CRT) . Next, in 
step 24, color and wavelet transformations of the image 
take place. The image transformations involved in this 
step include color transform for color images only, and 

25 wavelet transform for both gray level images and color 
images. In step 2 6, the values representing the 
transformed images are quantized and compared to 
thresholds. Values falling outside the threshold are 
discarded. In step 28, the remaining quantized values 

30 are encoded to remove redundant information,, creating a 
compressed image file. Next, in step 3.0 the compressed 
image file is generated as output. 

Referring to the color transformation of step 
24, digital color images are typically based on an RGB 

35 color model, such as is commonly used with TIFF or BMP 
.images. In order to get a higher -compression ratio, the 



RGB pixels are transformed to other color models, such as 
YIQ or YUV models. The method can convert RGB inputs 
into YIQ or YUV color spaces according to the following 
relationships . 
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In the YIQ color space, there is one 
luminescence (Y) and two color planes (I, Q) . The Y 

15 component is critical, while the I-Q components are less 
sensitive to error introduced by data compression. 

The wavelet transform (also referred to as 
wavelet decomposition) operates on the converted color 
space signals. The purpose of the wavelet transform is 

20 to represent the original image by a different basis to 
achieve the objective of decorrelation . There are many 
different wavelet transforms that can be used in this 
step. For instance, the reversible integer wavelet 
transform described herein below is a preferred wavelet 

25 transform. However, to develop a better understanding of 
the preferred transform, the following alternative 
wavelet transform is first described. 

Let C° = [C?*] (j - 0, . .., M-l; k = 0, . .., 
N-l) represent the original, uncompressed image, where M 
30 and N are integers which have the common factor 2 L (L is a 
positive integer) . A one-level wavelet decomposition, 
where L = 1, results in the four coefficient quadrants as 
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shown in Figure 2. Each quadrant represents a set of 
wavelet coefficients. 

Quadrant C 1 represents the blurred image of the 
original image C°, where C 1 - [c} k ] (j=o,..., M -i, *=o,..., 2T-i> . 

2 2 

5 HD 1 represents the horizontal high frequency part of C°, 
while VD 1 represents the vertical high frequency part of 
C°, and DD 1 represents the diagonal high frequency part of 
C°. The decomposition can be iteratively repeated L times 
to obtain diff erent levels of decomposition. For 
10 example, for L = 2, C° is set to equal C 1 . The iterative 
formula for computing a decomposition is given as 
follows : 

(1) Let C° = rC°, r>0 is a factor which can be changed for 
different needs. 
15 (2) Transform for image columns: 

For k=0, ...,N-1, calculate 

U 0Jt~ 5 / 

1 1 _ _ " (3.1.1) 

a- k = - ( , jt-2 c w , k ) , j -1 , ... , £ -1 . 



For k=0,...,N-l, calculate 



^OJc u i,Jt 2 ' 



cK=C - 3 h+ a j+i.k AT 



^-2 k=r-° - u ^-2 ^ 



(3.1.2) 



(3) Transform for rows: 

For j = 0, . . . M/2 - 1, computing 



-9- 



and 



For j 



= 0, 



2 



(3 



M/2 



lf computing 



\ddj,o s 2 



+ d,-.2le*l' ^ 



and 



= l dd^.J =0 '-' 2 



M -l. 



„ nse matrix 
can use 

necessary, q£ j le vels^C 



we also 



Sera, «' 15 tM , eTel «velet 

" rhe wavelet co value s the 

2 ' .old values, and xf ifi ed, th 

threshold v ld values v , s that 

&n W u are tnei- t> e xng 

n coe fficxents a d£a nt xs t . 

te nds to fte quencxes, b( 

for hig* spatxa- tWe shol^ method 

.„ B(1( i image- f 0 rm thre- _ 



20 



:ends to fteq uencies, fee 

for hig* spatxa- tWe shol^ * et *° d 

0 <*sed xiaage- imi form thre- 

compresses ile vel 

p, mun- iX r hosen 

d a , descried ^ Wl ,*e £ 



25 



1, l- 1 "* 'lis every entry » * ab3 ol»« 
ani Wl ler tb. »«"^thr.*oW ~>»» , and 

«* " eit ^ or P — •** 



TABLE 1 i a re quantization 

Table 1. entri6S and q% for 

Tn Table ±t ^ q vd he 

factor q c 1 o and 255. 

scheme for the bio ^ ^ 2 x 

ad^.j-o fr 1 ^ 0 

ground -^^Jf 

N _ x) a re gua*" zed 

Here, hd/.^' 0 '-' 2' ' ^ ap* (2-1 ^ 

wavelet coefficient* 

0iJci(N/2 

.rest integer of x 
j /v) gives the neare 
* .Hon round (x; y nation of tne 

. a nd the function ^ ^ ^ ^txzatr 

^ ati0n i 3 ^ants). ......... three separate 



15 



Equation separate 
biocks (q-drants) there are th- ^ . 

Fo r color i afferent colo ^ 

Len9 tn, or *»«-*■ ^ can „e sedated ^ tM 

compression as we 



<- that shown in FIG- 1 
a iternative process t color 
m ^ down sampling of tn twice to 

^ = an optional dowi once ox 

includes an op ling may be Qne _ 

^ an6S - Th " m a g e pi**" either one-f°- 
pr oduce two ^ P ^ Qriginal plane ^ ^ 

sixteenth the s.ze ^ accompl^ ? 

rt ;q done, ± z ^ A The down samy^ 

S " P Ttranstcn. of step 24. *>. £ile . 

^ "™Vd.» » «' ° Pti re" impressed 

IS quantized data^ ^ refine the d . 

processing taW P se d ^ 15 ° ;„ erse operation 

, st ep 50, the decomp . s the in v divtde d 

Tne decoding of it can 

o£ tM encoding of decoding (W f f»« « , 

2P ^r^d -«iCient 

— d ecoding Utep - 

3 *l+1 blocks. mian tizi n< 3 ^ TaDi 

coefficients » * ion taWe as quan 

uses tne sa« guant fM t . I. . • • 

, the scheme as u , 

25 and the # «. x . v 

^mate coefficients 
rtnces the approximate ^ 
i a 2 1) produceb w nich are suu 

Equation (4.2.1) P L) , wh , s 

for the blocks HD U ^ for other 

° The dequantiz^ic, 

FIG- 3. transform, ai-s 

similar to 4.1-2) . wave let d pri or 

In step ^o, u amotion, lS p . vc a 

30 f a - waV elet reconstruct 4 depots a 

referred to as «a transforma txon. ^ cji1b , 
t0 the averse co uC ti.on,- ~ 

. one -level wavelet 



■ „ can be iteratively 
1P , reconstruction can aCCO rding 
The wavelet rec dec0 mposxtion, 

W IW " Set ■ « _ if cal^ata 

For ' 2 



(4.3.D 



and 



2 



For 3 



1=0, 



M/2 



_ 1, calculate 



=c-j-o 



t hdjjc^Li!i ( lc=l,---2 



»-2, 



(4.3.2) 



(4.3.3) 



and (4.3-4 



rransf orm for column: 
(2 ) inverse transr _ N _ 1( calculate 



l0 . 

and 



For 



-14- 




\Cs-i.k- c lLZ,k -5--* 



C4.3.6) 



, 0 1 Ny- N 

Cj,k C 3' k ' 

. erse wavelet transformation, » 
FoU owina the «"« S * med . Equations < 5) 

— ^.rs^ ~ - - — 

,g iv e the inverse 

spaCSS - For «Q to M.K 2ll r<1 

LBj l 1.000 " 



isl-l i- 000 -°; 3 0 3 2 o.oooj LVJ 



15 



*n optionally apply ***** 
, B a user can op" „.-, ters are 
in step 48, a ali ty. Filters 

k „own m the art ^ choose any n 

brtgh tenina _^es ^ t « » ^ ^ 

^^"""the selected fil«» ""^W* • « le 
de£lnl 7 U e in a «. such as a ^^ yUl ^e niters, 
lm T in ' addition to optionally app 

header. • 



~ 15 " ted to automatically 
, « be iropl^ ente follow!^ 
the method - f^ele-d t il«» 
d etect and apply ( - lt er is «ed that 

— "Tsi-P- - ^^ctnt to the current ^ 
c well as the curr wei ghted vai tfee 

™ "lied to every P^ 1 1B evety pixel, * teS . 
is • Wll % 0 smooth «a 9 es, £ piy ,is « »1 

* the eight aaj comparea. 

, , he correspond erg a d 3 acent P 

pixel and *e ^ h ol ^ lt h 

20 calculated' ^ value 1/90 » pl!te l. 

be rcultrpl^ V a brrghten ^ ^ ttia t a 

pother niter that can £ ^ q£ ^ pix els 

ralue between l' 1 ' 
a ra ndom value ^ ^ preferred 

natd „are o* «■ * ^ u 

implementing an e 3 includes a „, all 

colter 66. f * ^ 66 

30 64, » 10 . include an 

coupled to a CW , pheral devrces ^ ^ as s 
communicates ««. P storage de ^ 

image source gh shown " e osing a 

£0 und in. computers. 



~ 16 ~ d'gital still image 

or video sour*^ In addition, the 

ne twotK " roeCtl J^- 0 30U rces, such as a analog 



ln ciude anaioa vid>o s ^ ^ tec ^er by th . 

vid eo SiOnaU ustn ,V 0 „vent,onal c a video 

S !" !w an i-Asource 72 can ttln , reai- 



0 



20 



Vi " P 85 using - include <* — 

AlternatlV d co^unicatio\syste m s for 

camera and com* sU ^ s tem 66 disk , 

tim e video to the ^ be a co P ^ 

Tne image s dr ive, or a p 

h as a that used bv a nard or a read/writ 

SUC such as a floPPY or ZI * 

m edium, sucn 

oPt^al CD a comput er P^^ed from 

nt n a P P cts of -7;;°;;^ memory 64 for 
implements a&y 76 int o tne 

^ TZ ^ «• <*" ""^ c jessed i» 9 e 

execution by the c , nventl on, the ^ 

expression aspect storage ^ 

m . can - -" decompression « * disP iay eB 

execution o£ be viewed on the 

the «' S ; e f t re controi of the '«^ thods set 

W ";rr; -ess i« g es ac-d^ 
c 62 can P , n nGS . 1 hardware 

7 iiiustrates an •"'J^. with a 
F . „ a svstem m ac<^ svstem 80 

plat£ o» «P^n, » * t invention. » . 

components, Ration of discr logic 

"-^"Jt's su , as -croprocessors 0 s,an^ ice ^ ^ 

components s programmable 1 9 ^ & 

components, and a com pression system 81 c an 



25 



30 



-n- 



10 



15 



„ be configured to 
■ le t he decompression ■ « ^ decoop ression 

»U* lZ 80 P-^^S can *tovide 

M 1B 9 r 84 The image sourc , mage 
toa color convey « asdescribed earuer 

the same functronality space 

" ° £ t 84 Per£ °su: * any of ^se 

We » the input Pi*^ s ' SU v C e h rter £u nctionalrty 
transformation on * e ^ ^ „ ^ 

ascribed "Conventional ^"^cturers . 

can be provide lb, {t om various manrf reK0VlM 
are readilV «*»^ , the transformed^ P , d b y 

Compressor 86 compres sed ^ ^ ? t o the 

E edundant data. Th cran sferred drr ^ 

th e compressor »6 ^ ^ tI ansmi-° comput er 

d ecompression sys« ^ ^ ^ b£ , ^ 
The transmission «d ne „ ort , or «t ^ ^ outpttt 

neW ort, cable tele ^ 86 tt a , 

^ lass sforage dev.ce «. ■*» 
" a r or M " trohlval system. 

Standard elect of the xnver 

r 8 iU-" ateS 3 fl °" w t' an alternative 
FIG- 8 m ar . c0 rdance witn & 



20 



25 



30 



35 



50- r 8 illustrates a fl- an alternative 

" ■ „e in accordance «th a 
compressing feeler .pace 

sigital image > roed on the 

; transformation w P 




-18- 



In step 104, the pixels are subjected to a wavelet 
transformation. In step 106, sub-band quantization is 
performed on the wavelet coefficients. Next, in step 108 
the quantized sub-bands are respectively entropy encoded. 
5 In step 110, the coded image file is output. 



coding are well suited for wavelet-based image 
compression. The main idea is to take the advantage of 
different quantizations at different sub-bands (wavelet 

10 quadrant) and encode each band accordingly. Quadrants 

having a high variance in wavelet values can be allocated 
a finer mesh size for quantization, while those quadrants 
with smaller variances will be assi'gned fewer levels of 
quantization. That is, the number of bits one wishes to 

15 allocate to the output could be varied by quadrant. 

Those quadrants with large variances will utilize more 
bits, while those with low variants will utilize fewer 
bits. In this way, the number of bits resulting from 
quantization will remain the same, but their allocation 

20,. will differ depending upon the nature of the image. This 
technique greatly improves image quality while 
maintaining a high compression ratio. 



decompressing an image compressed according to the 
25 methods shown in FIG. 8. Step 120, the compressed file 
is input. In step 122, the input image is entropy 
decoded. In step 124, de-quantization is performed on 
the decoded image file. Next, in step 126, an inverse- 
wavelet transform is performed on the image. In step 
30 128, an inverse color transformation is performed. In 
step 130, post-processing altering is optionally 
performed. In step 132, the decompressed image file is 
then displayed. 



.-embodiment of the present invention. .This method*. 
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FIG. 10 illustrates a flow diagram of a method 
of compressing an image in accordance with another 
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reduces the number of colors in the image to achieve 
compression. In step 140, the image is input with its 
original color. For example, each color pixel could be 
represented by a standard 24-bit value. Next, in step 
5 142,. a color table is created .corresponding to the image. 
The color table is a set of quantized color values. The 
quantized color values represent a smaller number of 
colors with correspondingly fewer bits. Each of the 
input pixels is mapped to the color table. In step 144, 

10 an index is calculated for each pixel in the image by 

dithering the pixel values. Dithering is accomplished by 
weighting pixels adjacent to the current pixel in a frame 
and then arithmetically combining the weighted values 
with the current pixel value ■ to . produce the index, which 

15 then represents the current pixel. The dithering process 
is repeated for each pixel in a frame. In step 146, the 
indexes are wavelet transformed. In step 148, the 
wavelet coefficients are entropy coded. In step 150, the 
coded image file is output. 

20 FIG. 11 illustrates a flow diagram of a method 

of decompressing an image that has been compressed 
according to the method shown in FIG. 10. In step 160, a 
compressed image file is received. Next, in step 162, 
the image file is entropy decoded. In step 164, an 

25 inverse wavelet transform is applied to the decoded data. 
Next, in step 166, post-processing filtering of the image 
is optionally applied. Next, in step 168, the 
decompressed image is displayed. 

^cjA ^^^^12 illustrates another method of 

30 compressing an imcrge in accordance with another 

embodiment of the preb^nt invention. In this method, a 
user can selective vary\ompression parameters (step 173) 
to obtain a lossless or neV-lossless compressed image at 
a desired compression ratio \ In step 170, the image is 

35 input. In step 172, an integer color transform is.. 

. performed on the input image-- \ln step 173, compression 
parameters -are- selected by the- user using a software 
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-22- 

, •« an even number, 
( N if N i s 
2' . e an odd number; 

its lo« frequency U> 

r^rt' 1 ana \On{ n =o 

\ c n]n=0 , alv For 

art respectively- 
, hic|h freque"« l»> p ' „, and repeat 

^ti-^veXs, we 1»t 

bv integer 

high pass ^ 
as*. 

10 




(2.D 



comput? 



^2) Compute 
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Ck =Int{ 2 (2.2) 
cl-A q i£WiS an odd number. 

. , arv rounding function 
T „Mx) is an arbitrary e xaiaple, 
Here, intOO nter pretations . , 

„ hich --"fr; which » x, 

5 etc. It 

,,».- la ndl^ »e integers. 

1 U ° „ can easily get the 

From (2-D- 12 tion algorithm 
snowing integer reconstruc 
^ Keconstructron ^ ^ 

(I) It N is an ( . 2 .3) 

c 2 jc*i ^ 2 
if N is an odd nu^er; we nave 



10 



(2) Compute 



(2.5) 
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emai 



Since (2.1) -(2.6) are not linear because of the 
ration Int(x), this means the transformation 



roundi 

order becom<^s s signif icant . For instance, if the 
decomposition applied first to the columns and then 

to the rows, the lWerse transformation must be applied 
first to the rows anoVthen to the columns. 



Example 2 : Lazy wavelet transform. 

The lazy wavelet transform is used to illustrate an 
important concept. The corresponding inverse transform 
is nothing else but sub-sampling the even and odd indexed 
samples. Decomposition and reconstruction can use the 
same formula as follows: 

dk=c£ k . lf k=Q , A^-l . 

Examples 1 and 2 are not good transforms for 
image compression, but they are simple. Much better 
transforms can be achieved from these two. As suggested 
above, they are considered only as a starting point for 
the integer, reversible, wavelet transform algorithm of 
the disclosed invention. 

It is noted that there is another interesting 
property in the above two transforms which may not be 
easily seen. If the values of the signal pixels are. 
represented by a finite number of bits, say one bit or 
one byte, the same number of bits can be used to 
represent the result of the forward transform within the 
computer itself because of the complementary code 
property. While, from the reconstruction algorithm, the 
computer will get back the exact original signal through 
the same complementary code property. This property is 
called a Property of Precision Preservation (PPP) for 
these wavelets.. 

^OJ^t is known that the general values for the high 
frequency wavelet coefficients are smal.lv and all higher - 
levels, of ..the decomposition also provide- 'generally small 
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values in the hYgh frequency band. This allows the 
preservation of precision during the computational stage 
of the wavelet coefficients. Now, the complementary code 
property, the other^aspect of the PPP property is a well 
known characteristic of integer arithmetic as done by the 
computer. Consider the\computation of the difference of 
two integers given as c \ b - a and the inverse 
computation of a = b - c. \The nature of the computation 
within the computer can be specified as follows: 



lb-a if -2 <3r - 1 ^jb-a<2^- x -l 
-2<*+b-a if b-a*2*- L 
2*+b-a if b-a< -2*- 1 



10 and the inverse is 



h-c m if -2^" l ijb-a<2^- 1 -l 



-2 q +b-c„ 



-P K _ / ^"~>Q' 



where the m subscript indicates the internal 
representation/ and the range of the integers a, b,. c 

is [-2 g ~ l , 2*' 1 -!] . The internal representation of c m when 

it is outside the range, its appearance is as a two's 
15 complement number, so the representation may not be the 
same as the external representation of c. However, the 
same complementary code for the a m will cause the internal 
representation to be identical to the external 
representation of a. For example, if we let b = 2 
20 (00000010) and a = -127 (10000001) then c m has the 

internal binary value of (10000001) when q=4 . With a 
value of -127 for c m the inverse value for a m will just be 
a. 

In fact, for Example 2, this property is 
25 obviously true. While for Example 1, if the range of the 
/--pixel values -ts* -within a finite number of bits, say *q, we 
can only use q bits as the working unit, which means the 
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value of transform coefficients will also be within the 
interval with length 2 q , say [-2 q_1 , 2 q_i - 1] . Due to the 
nature of computation on a machine, most machines will 
implement (2.1) -(2.2) automatically as follows (the 
complementary code property) : 



' o _ o 
c 2k <~2Jt+l 



if -2»- 1 ic 2 Vc 2 0 Jtn <2'- l ( 
c? k -c2 k+1 -2*, if c^ k -ci k ^2^\ 
2^(4-c 2 ° M ) ( if c 2 Vc 2 Vi<-2^. 



(2.6) 



Int{-±) +c 2 Vi, if -2'- 1 iJj2t(-JL) +c 2 Vi<2 < = r - l > 



2Jc*1^2 9 , 



(2.7) 



J^tC-^) +c 2 Vi+2^ if lnt(-^-) +c 2 Vi< -2*" 1 . 



While the reconstruction algorithm (2.3) and 
(2.5) will be implemented by the computer itself as 

d 1 H 1 
ct-lnti^), if ^ic^-^cf^) <2*, 
^ 2 



2* + (c^-Jiit(-|L)j / ifc/-i n t(|)<-2^ 1 , < 2 ' 8 > 
(c^-J^t^))^*, if c^-X^t(-^) v-2*"\ 



C 2k z 



if d£ + c° k ^<-2*-\ (2-9) 



It is obvious that (2.8) -(2.9) are just the reverse of 
(2. 6) -(2. 7). it is also easy to see that if we properly 
take advantage of the bound in the coefficient size 
mentioned above, the algorithm can be implemented using a 
minimal; .amount of storage. . - 
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The following are examples which give motivation 
for our new approach. 

Example 3 : A (2.6} wavelet transform by integer 
calculation (2) . 
5 This transformation is similar to using the 

following analysis filters: 



n 


-2 


-1 


0 


1 


2 


3 




0 


0 


1/2 


1/2 


0 


0 


9n 


-1/16 


-1/16 


1/2 


-1/2 


1/16 


1/16 



(a) Decomposition 
1° Decomposition starts with Example 1 at step (1) 

and (2), and then upgrades the high frequency component 
at step (3) : 
(1) Compute 



C?i ' ° = C 2 V C 2 Vi , * = 0 , ... , Ml - 1 



(2) Compute 



ji,0 



■EnC ( — ^— ) , +c£_ 1# if N is an even number, 



if N is an odd number; 



15 (3) Compute 

■ <4 J , = In t ( C *- i " C ** 1 ) -di - 0 , k=l , ... , ^ -2 , 
and then, if N is even, calculate 
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ri 1 c 4-2~ c 4-i ^ .1,0 

a «i-i -*nt{ ) - a^-! , 

else, calculate 

(b) Reconstruction 

The reconstruction algorithm is identical to the 
decomposition algorithm, except it is now running 
5 "backwards". 

(1) Compute 

and then/ if N is even, calculate 

_i _ i 
a^!-xnt( - ) -a^. lr 

else calculate 

c^-i-zntl ) -a^-i, 

(2) If N is an even number, compute 

10 or, if N is an odd number, we have 

C 2 Vi = Cjt-Xi2t<— |— ) , J fc=0,...,i\T 1 -2; 
^-1 = ^. 

(3) Compute 



We see in step (2) -(3) above, that they are just 
the same as shown for the reconstruction of the (2.2)- 
wavelet transform (Example 1) . 

Example 4 : A ( 1 , 3 ) -wavelet transform by integer 
calculation. 

The following nonlinear transform is a variation of the 
transform which uses biorthogonal analysis filters: 



n 


-1 


0 


1 




1 


0 


0 


1/4 


-1/2 


1/4 


9 n 









(a) Decomposition 

This decomposition starts with the Lazy wavelet 
at step (1) and upgrades the high frequency component at 
step (2) : 

(1) Set 

^ = C 2 Vi/*=0 / ». f M l -l. 

(2) If N is an even number, calculate 

Otherwise, if N is an odd number, calculate 
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d k =Int{ ) -c 2k + x , k=Q , ... , M^-l . 



(b) Reconstruction 
(1) Set 

c£ k =c£, ic=0 f ..- / i\^ 1 -l; 
(2) If N is an even number, calculate 
o o 

c 2 Vi = In t < C2 * + 2 Cz *- 2 ) - d i , ic =0 , ... , Af x -2 , 

_0 _ 0 jl 

Otherwise, if N is an odd number, calculate 



Example 5 : ( 5, 3 ) -wavelet transform by integer 
calculation. 

This transformation is also similar in function 
to using the biorthogonal analysis filters. It is given 
by 



n 


-2 


-1 


0 


1 


2 




-1/8 


1/4 


3/4 


1/4 


-1/8 


1/4 


-1/2 


1/4 


0 


0 


5 n 













(a) Decomposition 

This decomposition starts with Example 3 at step 
(1) and upgrade low frequency components at step (2) : 

(1) Set 
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If N is an even number, calculate 



-0 . _o 



d k -Int{ - ) -c 2Jt+1 , i:=0 / ... / Ar 1 -2 / 



Otherwise, if N is an odd number, calculate 



di=Ji2t(-E2f^2£2). C2Jt+1 , ic=0 ^-1 



(2) If N is an even number, compute 



d 0 x 



Otherwise, if N is an odd number, calculate 



ci-i-ei'.° 1 -r«t(-^i) • 



5 (b) Reconstruction 

{ 1 ) Compute 
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c&ci+lnt k=l r ..,N,-2, 

Then, if N is even, calculate 

ci,-cjL. 1 »j*e< < **- , * <a '- 1 ). 

4 

else calculate 
(2) Compute 

Then-, if N is even, calculate 

0 _ 0 *\ 

5 The PPP property for Examples 1-2 mentioned at 

the end of the previous section is also applicable for 
these three examples. It is obvious these three 
transformations are not really linear, but they are 
similar to the one using the corresponding filters given 

10 above. Especially, the filters in Example 3 and Example 
5 belong to, with minor modification, the group of the. 
best biorthogonal filters for image compression. 

Also, from the above three examples.,, we can note 
that if we begin with integer (linear or nonlinear) 

15 wavelet transformations and then use some proper 
upgrading formulas, we can get other, much better 
integer, wavelet transformations for image compression. 

Lifting Scheme and Integer- Biorthogonal Filtering 
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The Lifting scheme, discussed by W. Sweldens in 
"The Lifting Scheme: A Custom-Designed Construction of 
Biorthogonal Wavelet", Applied and Computational Harmonic 
Analysis, Vol. 3, No. 2, April 1996, is a recently 
5 developed approach for constructing biorthogonal wavelets 
with compact support. It can be used, with minor 
modifications, to create integer biorthogonal wavelet 
transformations. The following is an adaptation of the 
lifting scheme. 



10 Definition 1 . The set of filters {h, h, 



g}, a set of 



biorthogonal filters if the following formula is 
satisfied: 



VcaeR \ fn{<A>) M 1 ( co ) =1 . 

72(G)) h(CD+Tl) 

where 77? (ca) = 

[gr(co) gr(o)+7t)/ 
and h(u) =J]h k e- k< *ai2d g-(co) =V g*e' 

k k 

and similarly fox jt?(g>) , £(co) and g{o>) . 



■Jco 



The following lemma is the main result of the 
lifting scheme [1] reported as corollary 6 in that paper, 
15 Lemma 1 . Take an initial set of finite 

biorthogonal filters {h, *h, q° g} , then a new set of 
finite biorthogonal filters {h, h, g, g'} can be found as 



£(cd) =£° (a)) +^(00) s(2o)) 
flr(co) =sr° (o>) -A(o>) s(2o>) . 



r^>^> ^Similarly if we take 
iorthogonal filters, 
2 0 {h, 1T, g, g} can be 




h, g, g} as an initial set of 
new set of biorthogonal filters 
as can be found as 
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A(<a) =i3°(<o) +5r(<o) s(2u) 
^(u) -£(g>) g(2o>) . 

Here s (w) is a trigonometric polynomial and the 
corresponding filter s is finite, and so is 's (u) . 
Actually, regarding the filters (4.1) is equivalent to 



1 



or 



J. 



6wO 



Next we use the lifting scheme with minor 
modifications to create an integer, nonlinear, quasi- 

biorthogonal, wavelet algorithm. Suppose is a 

original signal, and are again its low and 

high frequency decomposition parts, obtained by using the 
filters {h, h, g, g} . 

If we use filters {£, g} for decomposition 
(analysis) , the corresponding decomposition algorithm is 



While the reconstruction algorithm will be 




related to the synthesis filter {h,g}. Here, parameters 
a c and oc d are positive constants with a c »a d =2. For 
example, in the situation of regular biorthogonal 
decomposition and reconstruction, a c =a d =/T; and for 
5 Example 1 through Example 5 above, a c =l and a d =2 . 

If the set of filters {h, Ti, g, g} is from (h, 
h °/ 9°f g} by (4.2b), then decomposition can be 
accomplished as follows: 



1 * Calculate 

a 

n 

10 2. Calculate 



The relative reconstruction scheme will be: 



1. Calculate 

2. Calculate 

^Q = oY^f C *'° h n-2k ^ d k9n-2k \ fa 

Here, equations (4.3) and (4.6) are just the wavelet 
15 (inverse) transforms using biorthogonal filters {h, *h, g° 
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g}. While (4.4) and (4.5) are forward and backward 
upgrading formulas . 

Similarly if the set of filters {h, h, g, *g} 
from the initial set of filters {h° h, g, g} by using 
(4.2b), the relative decomposition is: 

1 . Calculate 

c * =a c£ c nh n . 2k 

n 

i 

d k " a d2^ °n9n-2k- 
n 

2. Calculate 

a 1 

The reconstruction scheme is: 
1. Calculate 
1. Calculate 

d 1 



Calculate 



a d j 
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GQKQlJLaKy 4,1. . Suppose ±>i or thoganal fi 1 ters { A , £, g, g] 

are from initial filters {h, R° , g° , g) by the lifting scheme 
(4.1a) or (4.2a) . If the decomposition and reconstruction 
by filters {h, E° , g° , g} can be accomplished only by integer 
calculation, such as Example 2, we also can create a 
corresponding integer wavelet decomposition and recon- 
struction scheme which is very " close 11 to the original one 
by using filters {h,K,g,g,} . Here the word "close" means 
that the difference of the two decompostion schemes 
is just some rounding error, and this rounding error will 1 
corrected by the integer reconstruction scheme. 

In fact, if {c£'°} and {d£} are integer after (4.3) , 
we can calculate {cjj} by 

instead of (4.4). Here Int(x), as described in Section 
2, is an arbitrary rounding up function which satisfies 
x-1 <; Int(x) x + 1. It is obvious that (4.7) is very 
close to (4.4), and the exact reconstruction scheme can 
5 easily be obtained from 

and (4.6). There will be a similar result, if the set of 
biorthogonal filters {h, h, g, g} is obtained from the 
initial set of filters {h°, h, g, gf by using (4.2b). 

Except for the example shown in the Lazy wavelet 
10 (Example 2), most standard biorthogonal wavelet forms' 
cannot be performed directly by integer, even for one of 
the simplest wavelets, the Harr wavelet. However,- if the 
parameters a c/ and a d are properly chosen and the 
£.: v:.p transform algorithms, ^such^ as.. Example 1 and Example 3, 
,A 5 are slightly changed, a variation of the original 
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biorthogonal wavelet transforms with respect to the set 
of filters {h, h, g, g} is created. On the other hand, 
the parameters should be also chosen carefully to 
guarantee that only addition and shift operations are 
5 needed by the algorithm. 

If the set of filters {h, h, g, g} is obtained 
from a set of filters {h°, h, g, g} by the lifting scheme, 
and the set {h* h, g, g} is also obtained from a filter 
set {h, h, g, g}, one can repeatedly use Corollary 1 to 
10 get a "close" integer wavelet transformation. 

The Correction Method for Creating 
Integer Wavelet Transforms , 

Another approach for obtaining integer wavelets 

is using the so-called Correction method. The motivation 

15 of this method is from the S + P transform. The lifting 
scheme for generating biorthogonal wavelets can be 
considered as a special case of the correction method. 

; From this can be derived complicated filters with fast 
decomposition and reconstruction algorithms. 

2 -° Assuming a simple integer wavelet transform, 

such as Examples 1 through 3, the decomposition and 
reconstruction scheme of which can be formulated as 
follows : 

Decomposition 

cr=df c ({c n °}) 
dt-*-df a ({c$) 

25 Reconstruction 

c fl °-r*({c a l -°} # {d£- 0 }) (5.1) 

Here, (5.1) and (5.2) can be the same as (4.3) and (4.6) 
or other algorithms. 

In general, after the above decomposition, one 
may not be satisfied with the result. There may still be 
.3.0., . some correlation- among the • high •pass' components -because 
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of the aliasing from the low pass components, or the low 
pass components do not carry enough of the expected 
information from the original signal. Hence, one could 
make an improvement by putting some correction part on 
5 the high pass components or low pass components . There 
are many ways to accomplish this. However, for the sake 
of the integer calculation, it is preferable to use 
following correction method. To make a correction for 
the high pass part, the corresponding formula would be: 

cg=di'°-lnt(dc£ §k )k=-.., 0,1,2... (5.3) 
10 Here, dc k l is a correction quantity for d^ 1 

*i i 

°i<£'i + E *jd&? , ,0,1,2,... (5.4) 

have been chosen for the user's purpose such as reducing 
the redundancy among high pass components or some other 
special requirement. To preserve the int.eger 
15 calculation, any entries in both 

*l should be rational numbers with 
denominators being powers of 2. 

From (5.1), (5.3) and (5.4), it is easy to see 
the perfect reconstruction algorithm can be 

djt ' 0 =d£ + Zn ^(dc*) , ,m,m-l, m-2~ , ( 5-. 5 ) 



2 0 combined with (5.2). 

As mentioned above, the Lifting scheme is a 
special condition of the correction method. Examples 3 
through 5 can also be considered as the examples of this 
method. We next give an ex-ample of the Correction method 
25 which cannot be included in the group of Lifting scheme, 
- and also which does not result in a closed form of 
compact support for biorthogonal filters. 
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Example 6 : S + P transform, which is similar to 
using following analysis filters. 



n 


-2 


-1 


0 


1 


2 


3 




0 


0 


1/2 


1/2 


0 


0 


a. 


-1/16 


-1/16 


15/32 


-17/32 


7/32 


-1/32 



While the synthesis filters do not have compact 
support, the S+P transform can be implemented as follows: 
(a) Decomposition 

(l)Take the decomposition step of Example 1, 
10 that is, compute 



and 



dk ' ° = c° k - c 2 °jt*i , Ar= - 0 , 1 , - , M x - 1 ; 



ci = In t(— 5- ] + c°^i , k=0 ,-,N x -2, 



c n-l 



(2) Correction Step: Define S 0 = -1, S, = 1/ T = 1 and 

1 4 
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and now compute 



(b) Reconstruction 

(1) Compute 



d^=d^lnJlSLllEtEk^L 



,k=M x -2,~,l; 



(2) If N is an even number, compute 
c 2 *+i =c£ -In j , *=0 , - , N x -1 



or, if N is an odd number, we have 



(3) Compute 

Boundary Conditions 
There are two issues dealing with boundary 
?. i A^.? rin 5 if the Lifting scheme or the Correction method 
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is used to generate the integer wavelet transformations. 
The first is how to process the boundaries which occur in 
the start-up wavelet transformations. The second is how 
to deal with the boundaries in the deductive formula. If 
5 the boundaries in the start-up wavelet transform have 
already been established, then those in the upgrading 
formula are relatively easy to establish. For the 
Lifting scheme, the boundaries in both steps should be 
processed in the same way. While, for the Correction 

10 method, according to (5.3) -(5.4), one has more choices to 
process boundaries in the second step. Therefore, the 
process by which the boundaries in the start-up wavelet 
transformations are established is discussed. Assume 
compact supported biorthogonal wavelets. 0 1 ^ 

15 Suppose the original signal is ^ ^*ji\- 0 - For 

creating integer biorthogonal wavelet transformations, 
use the following symmetric extension: 

(1) .If current biorthogonal filters have even 
length, the boundaries of the signal are 

o o 

20 extended as £ = f >|c- ? \ z > * • • / 

(2) If the filters have odd length, the 
following extension is performed 

c; t c,; ; •• • 

Examples 1 through 5 use the boundaries given 
25 above. In Example 6, the start up wavelet transform uses 
the above boundaries but in the upgrading step, another 
boundary filtering is used. In addition, for arbitrarily 
sized images or signals, one can use the same technique 
described in the above examples to deal with this 
30 condition. 

As mentioned earlier, for many applications, 
lossless image compression is more important than lossy 
compression. The integer wavelet transforms described 
above provide the opportunity to compress without loss. 
35 It is also* obvious that the integer wavelet algorithms 



can be used wherever ordinary wavelets are used, 
especially in signal and image compression. However, for 
most computers, the integer wavelet transform is much 
faster than other wavelets and it uses much less memory. 

Peak Signal to Noise Ratio (PSNR) 
Controlled Compression 

Peak Signal to Noise Ratio (PSNR) is a widely 

used quality measurement. PSNR controlled compression 

allows users to choose their desired PSNR for the 

compressed image. In each of the compression methods set 

forth herein, a user can selectively set the PSNR and the 

desired compression ratio, as well as the initial 

quantization and threshold levels for each quadrant of 

wavelet coefficients, to obtain the desired image 

quality. 

For example, the wavelet map of FIG. 3 shows a 
total of 10 regions (quadrants) . Each of these ten 
quadrants can have two additional parameters associated 
with them. The parameters define the quantization and 
threshold values for that particular quadrant. Since- 
there are three planes for color (only one for gray 
level) the maximum number of parameters that the user can 
control is 60 — 10 for quantization and 10 for 
thresholding for each of the three color layers. In the 
case of a gray level image, there are only 20 parameters. 

If a compression ratio, or a quality factor 
which indirectly defines a compression ratio, is 
specified, then the user wants the compression ratio to 
remain identical over the changes in the parameters. In 
order to accomplish this, two parameters are monitored: 
the compression ratio and PS (peak signal to noise 
ratio). The PSNR is defined as PSNR = 20 log 10 (X/MSE) , 
where the X is the average absolute value of the pixels 
in the compressed image and MSE is the mean squared error 
measured between the compressed and original image. 
Holding the compression ratio constant, the PSNR needs to 




10 
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increase to improve image quality. The way to increase 
the PSNR is to reduce the MSE. 

An iterative method can be used to adjust 
parameters to achieve the desired PSNR. The step are as 
follows: 

(a) Pick an initial parameter setting P 0 ; 

(b) Quantize the wavelet coefficients with P 0 
and calculate the corresponding PSNR; 

(c) If the PSNR is close to the desired one, 
stop and output the coded file; otherwise, get 
an adjusted vector AP 0 and set P 0 « P 0 + AP 0 , 
go to step (b) . 

Progressive Decomposition 
Progressive decompression allows users to decode 

15 images at varying degrees of resolution, starting from 
the lowest resolution and progressing to the highest 
resolution. The advantage of this feature is that users 
can download small pieces of the coded file and view the 
image at lower resolution to determine if they want to 

20 download the whole image. Progressive decomposition can 
be used with any of the decompression methods previously 
disclosed herein. Progressive decomposition is 
accomplished according to the following steps: 

(a) Input the lowest bandpass component C 1 of 
25 the coded file and reconstruct the lowest 

resolution image 1°; 

(b) Display image 1°; 

(c) If the user is not satisfied with the image 
quality or the resolution is big enough for 
stop; otherwise, go to step (d) ; 

(d) Input the lowest three band-pass components 
HD 1 , VD 1 , and DD 1 successively in the current 
image file. Reconstruct the new image I 1 from 
C 1 , HD 1 , VD 1 , and DD 1 . Let 1° = I 1 ; go to step 

35 (b) . 



30 
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Image Map Editor 
The image map editor creates an image map over a 
compressed image file. This permits an image compressed 
according to one of the methods set forth herein to be 
5 easily integrated into a web page using an http link. A 
user selects one or several areas of compressed image, 
assigns one or more http links to the areas. The image 
map editor calculates the coordinates of the areas and 
outputs the HTML associate with the image. The user can 
10 add such information into program source code. Following 
is an example of such image map: 

< EMBED SRO"cow.cod" type="image/cis-cod" 
WIDTH="257" poly= "44, 45, 103, 78, 103, 86, 54, 
86, 54, 78", 

15 href = "ht1rp : //wwj. inf iiiup . iuiu">< / - EMBED? 

Non-Uniform Image Compression 
The present invention allows a user to perform 
non-uniform image compression. Essentially, non-uniform 
compression is accomplished by dividing an image into one 
20 or more rectangles, each representing a matrix of image 
pixels. Each rectangle can be compressed by any of the 
methods disclosed herein. 

For instance, referring to the compression 
method of FIG. 8, integrating the non-uniform compression 
25 feature with the method allows a user to partition the 
image into several parts with different interests. The 
user can then compress these areas with different image 
and/or compression qualities. The parts can have any . 
shape. v 

30 The non-uniform compression feature can be 

incorporated in to the method of FIG. 8. as follows. 
Steps 100-102 are performed. Then, the user creates 
bitmap matrices defining the partitioned areas. Each 
area is then wavelet transformed. Different 

35 quantizations are then applied to the different areas 
according to the transformed matrices obtained above. 
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Split and Merge Wavelet Algorithm 
for Big Image Compression 

This algorithm allows users to compress large 
images by partitioning them into smaller pieces. The key 
5 is to divide the original image into several smaller 
pieces and compress/decompress them separately by using 
overlap and de-overlap technique. With this technique, 
the individually compressed pieces are equivalent to 
compressed whole image. The user does not see any edge 
10 effects in the decompressed image, which normally occur 
with conventional split and merge methods. 

Also, with this algorithm, users can selectively 
decompress the whole image or choose a specific part to 
decompress according to an image map created during the 
15 compression phase. The algorithm is preferably 

implemented as a software program executing on a general 
purpose computer. 

There are two ways to compress an image by- 
splitting it: automatically or interactively. The 
20 automatic approach is transparent to users since the 

algorithm will automatically split'-- to the image according 
to the characteristics of the computer used to perform 
the compression. Using the automated method, the 
algorithm first detects the size of the source image and 
25 the memory size of the host computer. Next, the image is 
split into several pieces with a predetermined number of 
pixels overlapping according to the image size and 
computer's memory. Overlapping pixels are those that • 
appear in more than one piece of the split image. 
3° Each piece of image is compressed in. order 

according to any of the methods disclosed herein from the 
image resource. 

The split image is decompressed as follows. 
First, the headers of the compressed image pieces are 
35 read to determine their order and compression parameters, 
such as quantization thresholds and decomposition levels. 
_ Next, each piece of the image is * decompressed and de- 



overlapped. Merge all pieces together in the proper 
place for display. 

Using the interactive method, a user can 
indicate how many blocks they want to divide the image 
into and how many pixels they want for overlap. To 
compress an image according to this approach, the size of 
the source image is first detected. Then, the user's 
choice for the number of blocks and number of overlapping 
pixels is entered. Next, the image is divided into the 
pieces according to the user's choice and the size of the 
image. Finally,, the individual pieces are compressed 
according to one of the methods disclosed herein. 

The interactively split image is decompressed as 
follows. First, the header of the coded image is read.. 
Next, an image map is displayed for the user to look at 
what the image context is about. The user can then • 
choose to display entire image or a specific piece of 
image. If user chooses to display a single piece of 
image, the algorithm finds the position of this coded 
piece and decompresses it. If the user instead chooses 
to" display the entire, image, the algorithm decompress 
each piece of image .and de-overlaps it. All pieces are 
then merged together in the appropriate display location. 

Example A, below, shows further technical 
details related to the present invention. 
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Attach'ed in Appendix A is a listing of a 
computer that is related to the present invention. 

While specific embodiments of the present 
invention have been shown and described, it will be 
5 apparent to this skilled in the art that the disclosed 
invention may be modified in numerous ways and may assume 
many embodiments other than the preferred form 
specifically set out and described above. Accordingly, 
it is intended by the appended claims to cover all 
10 modifications of the invention which fall within the true 
spirit and scope of the invention. 



